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ABSTRACT 


This  is  Che  third  paper  in  which  we  study  iterations  using  linear 
information  for  the  solution  of  nonlinear  equations.  ■In  Wasilteowefci 
amh-f-7^  ye  have  considered  the  existence  of  globally  convergent  iterations 
for  the  class  of  analytic  functions.  Here  we  study  the  complexity  of  such 
iterations.  We  prove  that  even  for  the  class  of  scalar  complex  polynomials 
with  simple  zeros,  any  iteration  using  arbitrary  linear  information  has 
infinite  complexity.  More  precisely,  we  show  that  for  any  iteration  f'ax id 
any  integer  k,  there  exists  a  complex  polynomial  f  with  all  simple  zeros  such 

C  /J&  A  tr- 

that  the  first  k  approximations  produced  by  y .do  not  approximate  any  solution 
of  f  *  0  better  than  a  starting  approximation  x^r  This  holds  even  if  the 
distance  between  ,xn  and  the  nearest  solution  of  f  *  0  is  arbitrarily  small. 
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1.1 


1.  INTRODUCTION 

In  Chls  paper  we  continue  the  study  of  iterations  using  linear  in forme- 
cion  for  the  solution  of  nonlinear  equations  f  ■  0.  In  Wasilkowski  [78]  we 
have  proven  that  no  stationary  iteration  using  linear  information  can  be 
globally  convergent  for  the  class  of  scalar  analytic  functions  with  simple 
zeros.  In  Wasilkowski  [79]  we  have  exhibited  nonatationary  iterations  which 
are  globally  convergent  for  the  class  of  analytic  functions  with  simple  zeros 
even  for  the  abstract  case. 

In  this  paper  we  deal  with  the  complexity  of  iterations  using  linear 
information.  We  prove  the  surprising  result  that  any  such  iteration  has 
infinite  complexity  even  for  the  class  3  of  scalar  complex  polynomials  with 
simple  zeros.  To  make  this  negative  result  as  strong  as  possible  we  have 
chosen  a  relatively  simple  class  Furthermore  we  deal  with  a  very  general 
definition  of  information  and  iteration.  Namely,  any  sequence  of  linear  finite 
dimensional  operators  is  considered  as  possible  information,  and  any  sequence 
of  functionals  as  an  iteration.  We  also  do  not  specify  which  tero  of  f  is 
approximated,  and  the  assumptions  concerning  the  starting  points  are  very  weak. 
Under  these  assumptions  we  prove  that  for  any  positive  L,  any  integer  k,  and 
any  Iteration  <p  using  linear  information,  there  exists  a  complex  polynomial  f 
having  only  simple  zeros  such  that  the  distance  between  a  starting  approxima¬ 
tion  Xq  and  a  nearest  zero  cr  of  f  is  no  larger  than  L  and  the  first  k  approxi¬ 
mation  produced  by  <p  do  not  approximate  any  zero  of  f  better  than  Xq.  Note 
that  L  can  be  arbitrarily  small  which  means  that  Xq  can  be  arbitrarily  close 
to  a. 
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Let  S(f)  denote  the  set  of  all  zeros  of  f.  By  the  complexity  of  an 
iteration  we  mean  the  total  cost  of  producing  an  approximation  x^  where  N 
is  the  minimal  index  such  that  dist(x^,S(f))  £  c  dis t (xQ , S (f ) )  for  a  given 
number  e,  e  <  1.  We  do  not  specify  exactly  what  we  mean  by  the  "cost". 

We  merely  assume  that  the  cost  of  the  assignment  operation  is  not  zero. 

Thus,  the  complexity  of  an  iteration  is  at  least  proportional  to  N.  Since  we 
shall  show  that  N  can  be  arbitrarily  large  for  some  polynomials,  this  proves 
that  for  every  e  the  complexity  is  infinite  in  the  class  3*  This  is  a  very 
strong  result  since  even  assuming  (theoretically)  that  all  operations  except 
assignment  are  free,  the  complexity  is  still  infinite. 

This  paper  also  illustrates  the  important  difference  between  the  concepts 
of  global  convergence  and  complexity.  The  class  of  all  linear  information 
supplies  enough  knowledge  about  f  to  guarantee  the  existence  of  globally  con¬ 
vergent  iterations  but  the  complexity  of  any  such  iteration  is  infinite. 

We  summarize  the  contents  of  the  paper.  For  the  reader's  convenience, 
in  Sections  2  through  5  we  deal  only  with  iterations  without  memory.  In 
Sections  2  and  3  we  define  information,  iteration  without  memory,  globally 
convergent  iteration,  and  complexity  of  an  iteration.  In  Section  4  we  prove 
two  theorems  which  play  an  essential  role  in  the  proof  of  the  main  result 
which  is  established  in  Section  5.  In  Section  6  we  extend  all  results  to 
iterations  with  memory.  In  Section  7  we  pose  some  open  problems. 


2.1 


2.  INFORMATION  AND  ITERATIONS  WITHOUT  MEMORY 

For  the  reader's  convenience  we  repeat  the  very  general  definition  of 
information  and  iteration  without  memory  introduced  in  Wasilkowski  [79]. 

For  simplicity,  in  Sections  2  through  5  we  deal  only  with  iterations  without 
memory.  The  extension  to  the  general  case  is  given  in  Section  6. 

Let  H  be  the  class  of  all  complex  polynomials  and  3  be  the  subset  of  H 
which  consists  of  all  polynomials  having  only  simple  zeros.  Let  S(f)  denote 
the  set  of  all  zeros  of  f,  f  €  H.  Consider  the  solution  of  a  nonlinear 
equation 

(2.1)  f(x)  -  0,  f  €  3. 

To  solve  (2.1)  iteratively  we  must  know  something  about  f.  Let 
Lj'.H  x([  -*  (£  be  a  functional  which  is  linear  with  respect  to  the  first 
argument,  i.e.,  L^(c^f^  +  m  c^L^(f^,x)  +  i  *  l,2,».»,n. 

Then  the  linear  information  operator  31,  31  »  [L^^*  •  • .  »Lq]  :  H  X  C  -*  <Ln,  is 
defined  as 

(2.2)  3i(f,x)  -  [L1(f,z1),L2(f,z2) . Ln(f,zn)],  Vf  6  H,  Vx  6  d 

where  z^  ■  x  and 

Zj  m  l*^(f  »z^)  , Lj (f  »z2)  *  *  *  ’  *Lj« i(f  •*  j-l) ) 

for  some  functions  5ji  j  *  2 ,3 , . . . ,n.  Thus  any  Zj  depends  on  the  previously 
computed  information.  For  brevity  we  shall  sometimes  write  Zj  “  Zj(f).  Let 
be  the  class  of  all  such  information  operators. 
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Consider  a  sequence  of  linear  information  operators  Jl  =  [12.  },  !^.  6  •) 

l  ni 

Let  Xg  be  an  approximation  of  a  solution  of  (2.1).  Suppose  we  construct  a 
sequence  of  approximations  {x^}  by  the  formula 


(2.3)  x1  =»  9i(xQ;  (f  ,xQ) ) 


where  cp^  :  c  '1.  -*  C  are  functionals,  cc^  €  5(2L).  Then  the  sequence 

cp  =  {cpi}  is  called  an  iteration  without  memory  using  <Ti,  cp  €  §(") . 
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3.  COMPLEXITY  OF  ITERATIONS 

In  ehis  section  we  define  the  complexity  of  an  iteration.  Let 

dist(x,S(f))  ■  inf  |x-®| 
or€S(f) 

denote  the  distance  between  the  point  x  and  the  set  S(f).  Let  L  be  a  positive 
number  and  let  9  be  an  iteration  without  memory.  For  any  f  6  3  and  such 
that 

(3.1)  dist(x0,S(f))  <  L, 

consider  the  sequence  {x^}  generated  by  cp.  For  any  e,  c  <  1,  define 
N  •  N(tp, c,Xq, f)  as  the  minimal  integer,  if  it  exists,  such  that 

(3.2)  dist(xN,S(f))  sc  dist(x0,S(f)), 

and  N  «  +  ®  otherwise.  The  number  N  is  determined  by  how  many  iterative 
steps  are  necessary  to  reduce  the  starting  error  by  c. 

Let  comp(<p,c,Xg,f)  be  the  total  cost  of  computing  x^  satisfying  (3.2). 

We  do  not  specify  exactly  what  we  mean  by  the  "cost".  We  merely  assume 
that  the  cost  of  the  assignment  operation  is  not  sero.  Since  any  iterative 
step  performs  at  least  one  assignment  operation,  there  exists  a  positive 
number  c  such  that 

(3.3)  comp(9,c,x0,f)  a  cN(9,c,x0,f) ,  V^,«,xQ,f . 

In  Wasilkowski  [79]  we  showed  there  exist  globally  convergent  iterations, 
is.,  Iterations  which  for  any  xQ  and  f  satisfying  (3.1)  construct  a  sequence 
{x^}  such  that 
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(3.4)  lim  x.  6  S(f) . 

t-=c  1 

(This  also  holds  for  L  =  +  “.)  Note  that  for  any  globally  convergent  iteration 
the  number  N(<p,s,x0,f)  is  finite  for  any  positive  e,  any  xQ,  and  any  fixed 
f  from  3* 

We  shall  show  that  N(o, e ,Xq , f )  is  unbounded  for  a  subset  of  3*  Let 

(3.5)  3(xfl)  =  [£  €  3  :  dist(xQ,S(f))  <  l}. 

Thus,  3(xq)  is  the  set  of  all  polynomials  f  from  3  f°r  which  the  distance 
between  the  initial  approximation  x^  and  the  nearest  zero  of  f  is  less  than  L. 
Let 

(3.6)  N('p,e,x  )  =  sup  N(cp,e,x  ,f) 

£S3(x0) 

be  the  minimal  number  of  iterative  steps  which  are  necessary  to  reduce  the 
starting  error  by  e  for  all  f  from  30<q)  •  Similarly,  let 

(3.7)  comp(cp,  «,xj  =  sup  comp(q>,  e,x.,f) . 

0  f«3<V  0 

Due  to  (3.3)  , 

(3.8)  comp(cp,  c,Xq)  *  cN(;p,  e,xQ) ,  Vcp.e.Xg. 

It  is  intuitively  obvious  that  for  e  *  0,  N(cd,0,Xq)  *  +  *.  In  Section  5 
we  prove  thac  for  any  L  6  (0,+  ®],  any  iteration  cp  using  linear  information 
and  any  xQ  €  C, 

N(<p.e.x0)  ■  +  ®»  €  [0,1) 


which,  due  to  (3.8),  implies  that 
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comp(9,«,x0)  -  +®,  Ve  €  [0,1). 

This  means  that  the  cost  of  reducing  the  starting  error  may  be  arbitrarily 
large  for  some  polynomials  from  3  even  if  xQ  is  very  close  to  a  solution. 
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4.  TWO  THEOREMS 


la  this  section  we  prove  two  theorems  which  play  an  essential  role  in  the 
proof  of  the  main  result.  Although  Theorem  4.1  is  intuitively  obvious  its 
proof  is  long  and  difficult.  Since  this  theorem  is  basic,  it  would  be  inter¬ 
esting  to  find  a  simpler  proof. 

We  first  define  a  linear  operator  used  below.  For  any  linear  information 
operator  ?!  =  [L^ ,L2 , . . . ,Ln] ,  "  S  ’?n>  and  any  Xq  we  define  a  linear  operator 
?!f,  f  6  H, 

(4.1)  ?!f(g)  «  [L1(g,21),L2(g,22),...,Ln(g,2n)1,  wg  6  h. 


where  =  x^  and 


(4.2) 


*  z,(f> 


W 


f'|(f>z^)>I'2(f,22  ),...,  ^(f,2^_^)) 


are  defined  by  the  information  operator  ?!  for  the  polynomial  f.  By  ker  ^ 
we  denote  the  kernel  of  ?!^.  We  first  establish 


Theorem  4 ■ 1 

For  any  integer  n,  any  linear  information  operator  ”,  ?!  €  •!:  ,  any 
integer  k,  any  functionals  ,to2  , . .  •  ,3^  €  ?(”) »  and  any  starting  point 
Xq  6  (L  *  there  exists  a  polynomial  f  €  3(xq)  such  that 

(4.3)  x0,x1,.*.>xjc  4  S(f) 

where  x^  =  co^x^;  ?!(f,Xg)),  i  =  l,2,...,k.  D 

Proof  (induction  with  respect  to  n) 

We  first  prove  (4.3)  for  n  =  1.  Since  ?!  €  there  exists  a  non2ero 
polynomial  h,  h  €  H,  satisfying 


(4.4)  3l(h,x0)  -  0. 

Then  there  exists  3,  (3  €  (0,-|)  ,  such  that  h(xQ+f3)  £  0.  For  positive  a,  define 

f  (x)  “  x-xA- 3fOh(x) . 

Let  y1(cr)  ,y2(a) , . . .  ,yr(o)  be  the  zeros  of  f^  where  r  is  the  degree  of  h.  From 
the  theory  of  algebraic  functions  (see  e.g.,  Wilkinson  [63])  we  know  that 
y1(o)  f  xq+3  and  y^(o)  -»  xQ+f3  as  a  tends  to  zero.  It  is  possible  to  show  that 
the  y^(a)  are  simple  zeros  and  |yi(cr)  |  -»  +  ®  as  a  goes  to  zero,  i  2  2.  Thus, 
for  sufficiently  small  cr,  f  6  3(x«)  an<*  f  (xft)  t  0*  Due  to  (4.4), 

3t(f0,Xg)  **  ^(x-Xq-PjXjj)  which  means  that 

xi  "  'Pi(x0>2l(fff»x0))  *  cpi(x0,3l(x-x()-P,x0)) 

does  not  depend  on  a,  i  ■  l,2,...,k.  Note  that  there  exists  a  small  such 


(4.5)  (xq*^,...,*^  D  {y1(<J1),y2(a1),...,yr(o1))  -  jb. 

Indeed,  for  small  owe  have  |y.(o)|>  max  |x  |  for  j  *  2,3,..,,r.  Since 

J  0SJ.Sk  1 

y^(a)  takes  infinitely  many  values  as  ?  tends  to  zero,  there  exists  o^  such 
that  y.(o.)  f  x. ,  i  »  l,2,...,k,  which  proves  (4.5).  Taking  now  f  ■  f  ,  we 

it  i 

get  f  6  3(xq)  and  XQ»xi»***»xk  £  S(f).  This  completes  the  proof  of  (4.3)  for 
n  *  1. 

Suppose  now  by  induction,  that  (4.3)  holds  for  n  £  n^.  We  want  to  show 
that  (4.3)  also  holds  for  n  *  n^+l.  On  the  contrary  assume  that  there  exist 

31*  6  *  , 

n  n 

*  *  *  * 

■'ll  "  CLi»L2,,",Ln^' 


it 

k,  ' '  • '  > ^  5(?M  an<i  x0  ^  ^  suc^  thaC  f°r  any  polynomial  £  €  3(xQ) , 

(4.6)  Si  6  C 0 , k ]  :x.(f)  =  cpi(xQ;  \(f,xQ))  €  S(£) . 

Define  the  information  operator 

an-l(f,X0)  =  [L1(f,*1),L2(ft*2)....,Ln_1(f,*n_1)] 

it  it  it  it  k 

where  z.  are  given  by  ?!  .  We  shall  construct  functionals  rs.  , . . .  ,<s.  6  -  (?!  .) 

l  n  i  z  k  n-  i. 

r  *  *  .**  *  * 
such  that  the  set  [xq.x^,  . . .  x.  =>  x^f)  *  -p.(x0;  ^^(f  ,x  ))  ,  contains  a 

if 

zero  of  f  for  any  polynomial  f  from  3(x.)  .  Since  ?!  .  €  i|r  ,  this  will  be  a 

u  n- i  Uq 

contradiction. 

Let 

Al  =  {f  €  3(xq)  :  f (xQ)  =  0} 

if 

and  let  be  the  set  of  all  f  €  $(Xq)  f°r  w^icl1  the  functional  Ln(*,zn(f))  is 

linearly  dependent  on  the  functionals  L^.z^Cf)),  L2('>z2(^^ . ^  ( •  ,zn_  ^  (f  1 )  , 

i.e.,  f  €  A„  iff  there  exist  constants  c,,c„,...,c  ,  such  that 

Z  1  z  n- 1 

n- 1 

(4.7)  L*( • , z  (f) )  =  2,  c.L*(*,z  (f)). 

n  n  • — ■  J  J  J 

j-i 

Note  that  c^  depends  on  the  values  z^(f) ,z^ (f) , . . . ,zn(f)  and  the  functionals 

★  if  ie  if 

L. ,L„ , . . . ,L  .  Observe  also  that  for  f  €  A„  we  do  not  have  to  compute  L  (f,z  (f)) 

1  z  n  z  n  n 

since, 

n-1 

Ln(f>zn<f))  B  1  c.L*(f,z.(f)) 
j=l 

is  expressed  by  the  previously  computed  values. 

Let 

(4.8)  A3  =  3(x0)\(A1UA2). 


4.4 


* 


Then  for  any  f  €  A^»  f(Xg)  f  0  and 

(4.9)  L*(-,zn(f))  0  lin{L*(.;21(f)),I^(*,z2(f)),...,L*_1(f))}. 

For  an  information  operator  31  and  f  €  3,  let 

B(3l^)  ■  (or  6  C  :  Vh  €  ker  !Jlf »  h(er)  ■  0} 

where  31  is  a  linear  operator  defined  by  (4.1).  We  need  the  following  lemmas. 
Lemma  4.1 

If  A3  f  then  for  any  f  6Aj, 

S(f)  n  B(3l*_1>f)  +  fi. 

Proof 

From  (4.9)  there  exists  a  polynomial  C»  C*  C(f)  €  H,  such  that 

*  * 

L.(C»*..(f))  *  1  and  C  €  ker  3t  .  Define 

n  U  U"  1  y  X 

gCT(x)  *  f(x)+oC(x) 

for  <j  >  0.  Since  f  has  only  simple  zeros,  then  as  In  the  proof  for  n  *  1,  we 
can  conclude  that  has  only  simple  zeros  which  tend  to  the  zeros  of  f  and 
to  infinity  (if  the  degree  of  f  is  less  than  the  degree  of  C)  as  <r  goes  to 
zero.  Thus,  g^  €  3(Xq)  f°r  sufficiently  small  <y.  Note  that 
Lj (gff»Zj(f))  *  Lj(f ,Zj(f))  for  j  «  l,2,...,n-l  which  means  z^(f)  ■  for 

j  *  l,2,...,n.  Thus  g^  0  Aj.  Since  x^  0  S(f) ,  then  Xq  also  does  not  belong 
to  S(g^)  for  sufficiently  small  a,  say  a  €  (0,Og) .  Thus  g^,  6 

3i0  "  i0(<r)  €  [l’k]  :  xi  ^  <V  VVV* 


6S(ga),  My  €  (0,<r0) 


Consider 


Let  h  be  an  arbitrary  polynomial,  h  €  ker  31 

u ,  r 


3(x)  -  gCT(x)+f?h(x) 


where  3  is  a  sufficiently  small  number.  Then  g  s  €  A,  and 

U  ,  p  -J 

k  k 

31  (g  ,Kn)  =*  31  (g  „,x„)  which  means  that  x.  (g  a )  x  x.  (g  )  does  not  depend 
n  <j  0  n  <t,p  0  l  <J,f5  i  <T 


S,  i  =  l,2,...,k,  and  therefore 


h(x  (g  ))  =0,  Vcr  6  (0,oQ). 
iQ  a  0 

k 

Since  h  is  arbitrary,  this  yields  that  S(g+a£)  fi  B(31  ,)  is  nonempty. 

n,i 

Let  h  6  ker  31  ,  be  a  nonzero  polynomial.  Then  there  exists  in  =  in(a)  €  [l,k] 

n,  f  u  u 

such  that  x.  is  a  zero  of  g  +  o£  and  h,  a  £  (0,c  ).  Since  a  takes  infinitely 
10 

many  values,  there  exist  distinct  and  ,  both  from  (0,Oq),  such  that 

k 

i qC^)  *  i 0(52).  Let  i  x  -  i0(a2)  and  xf  -  x..^  )  =  x^g^).  Then 

0  =  ga  (x*)  =  f(x*)  +  a:C(x*) 

0  *  gCT  (x*)  =  f(xi)  + 

k  k 

This  means  f(xt)  =  C(xi)  ■  0  and  since  h  is  arbitrary,  we  get 

x*  €  S(f)  r  S(Q  H  BCSl*  f) . 

*  ,  * 

Since  ker  31  .  ,  *  lin i £  j  0  ker  31  ,,  see  (4.9)  and  the  definition  of  £,  we 

n- 1 ,  t  n ,  i 

get  x.  6  S (f )  H  B(31  .  .) .  Thus  S(f)  d  B(31  )  is  nonempty  which  completes 

i  n-i.,1  n-  i,£ 

the  proof  of  Lemma  4.1.  H 

For  any  f,  f  S3(xq)»  let  r  ■  r(f),  j  ■  j(f),  (j  ■  l,2,...r)  be  indices 
such  that  {L.  (*,z  (f)),  L.  (*,z,  (f)),...,L  (**2,  (f))}  is  a  basis  of  the 


1  v  ’  i  ' 
.J1  J1 


j  j 

Jr  Jr 


space  lin  £l^(*  ,z^  (f)),L2(.,z2(f)),...,  Ln-l(f))}.  Let  CrC2 . Cr»  C^f)  6  H, 


be  polynomials  satisfying 


4.6 


We  define 


and 


Vci’Vf» 


0  if  s  ^  i. 


*£  *  i  <£>*j  <£»<=s 
.-1  5  8 


A4  -  Cf  €  3(x0)  *.  S(wf)  n  B(3l*_ljf)  f  ft). 

Lemma  4.2 

(i)  a3ca4, 

(ii)  if  A^  /  jd  then  for  any  f  €  A^, 

S(»f>  n  B(5*_ljf)  C  S(f). 

Proof 

Without  loss  of  generality  we  can  assume  that  A^  is  nonempty.  Let  f  €  t 

be  arbitrary.  Then  h  —  f-w,  €  ker  Ut*  ,  and  from  Lemma  4.1,  there  exists 

t  i  n- 1 ,  r 

* 

a  €  S(f)  (I  Ulus,  w^(or)  ■  f(o)-h^(o)  ■  0  which  means  that 

* 

S(wf)  f)  B(Stn>>1^f)  is  nonempty.  Thus,  f  6  A^  which  proves  that  A3  c  A^. 

To  prove  (ii) ,  let  f  be  an  arbitrary  polynomial  from  A^.  There  exists 
*1  €  S(wf)  n  Since  hf  €  ker  St*_1>f.  f^)  -  wf (a^+hj (a^  -  0 

which  means  that  6  S(f).  Thus,  Lemma  4.2  is  proven.  ■ 

Note  that  knowing  3ln_1(f,xQ)  we  can  verify  whether  f  belongs  to  A 
i  -  2,4.  Furthermore  for  any  f  €  3(xQ)  with  3l*_l(f,xQ)  -  Ul*_1Cf ,xQ) ,  f  6  At 
iff  f  €  At,  i  -  2,4.  For  i  -  1,2, ..,k,  define 


4.7 


a  €  S(wf)  n  B(^_1>f)  if  f  6  A4, 

n- 1 

W  L  CjLj(f’zj(f))])  if  ?  6W 

j-1 

0  otherwise, 

~  ~  *  i; 

where  f  €  3(xg)  an<*  ^n-l^,x0^  =  ^n-l^,x0^‘  Thus,  the  functionals  $  are  well- 
k  k 

defined  and  cp^  6  Furthermore 

(4.10)  Vf  €  3(x0),  3iQ  €  [0,k]  :  x.^  6  S(f). 

*■  k 

Indeed,  if  f  €  A.  then,  due  to  Lemma  4.2(i  i)  ,  ©  (x  ,n  (f,x  ))  -  or  6  S(f)  for 
4  i  u  n- 1  u 

any  i  =  1,2,. ..,k.  If  f  €  3(xq)'''A^,  then  due  to  Lemma  4.2(i),  f  6  Aj  J  which 

means  that  either  xQ  6  S(f)  or  cp*  (xQj  3*_1(f ,xQ))  *  ®t  (xQ;  S*(f,xQ))  6  S(f) 

*  0  *  *  ® 

for  some  i  €  [l,k].  Since  a.  6  §(5l  .)  and  51  ,  S  ■)  ,  (4.10)  contradicts  the 

U  1  u- L  n- 1  Oq 

inductive  assumption.  Thus,  the  proof  of  Theorem  4.1  is  completed.  Q 

Theorem  4.1  says  that  for  any  linear  information  operator  51  and  any  finite 
number  of  functionals  » •  •  •  >9^  €  1(51),  there  exists  a  polynomial  f  €  3(xg) 

such  that  no  point  x^  *  cp^x^;  "2(f,Xg))  is  a  zero  a  of  f.  Now  we  show  that  xi 
cannot  approximate  a  better  than  x^. 

Theorem  4.2 

For  any  integer  n,  any  linear  information  operator  51,  SI  *  [L^  ,1^ ,  .  •  •  ,Ln]  €  fn» 
any  integer  k,  any  functionals  ,©2 , . . .  .tp^  €  ?(2Q  and  any  starting  point  xQ  €  C, 
there  exists  a  polynomial  f  €  3(xq)  such  that 

min  dist(x.,S(f))  -  dist(xn,S(f))  t  0 
i=0, 1, . . . ,k  1  u 

where  xt  »  x^f)  ■  cpi(xQ;  D(f,xQ)).  ■ 


4.8 


Proof 


From  Theorem  4.1,  there  exists  a  polynomial  g,  g  €  ^(xQ) ,  such  that 

xQ,x1  -  x^g) . \m\(&  &  S(g).  Let  I  -  [i  €  [l,k]  :  x^g)  J*  xQ].  If  I  -  jtf 

then  for  f  ■  g  we  have 

0  ^  dist(Xg,S(f))  -  dist(x1(f) ,S(f)) ,  Vi  -  1,2,. . . ,k, 
which  completes  the  proof. 

Suppose  therefore  that  I  f  jb.  Consider  a  polynomial  w  of  the  form 

n 

(4.11)  w(x)  -  I  |(x-xt)m(x-xQ)  £  ®jX^ ,  m  -  max {3n, deg  g}, 

i€l  j-0 

satisfying 

(4.12)  3t  (w)  -  0. 

O 

Note  that  (4.12)  is  equivalent  to  the  following  system  of  n  homogeneous  linear 
equations 

n 

(4.13)  £  ajLs(l  l(x-*l)m(x-x0)xJ**s(8>)  "0  *  *  1,2,. ...n. 


Since  (4.13)  has  more  unknowns  than  equations,  there  exists  a  non- taro  polynomial 
satisfying  (4.11)  and  (4.12).  Consider  the  factorization  of  w. 


r(x)  •  (x-x.)  °|  |(x-x  )  lrL](*-y.)  J 

u  i€I  1  J-I  i 


for  some  r,  r  s  n,  s1,s2,...,sr  and  pQ,  p^  for  i  €  I  where  y^  f  x1  for  any  i  and  j. 


Due  to  (4 . 11)  , 


(4.14)  pQ  s  m-1  and  p^  2  3n  for  i  6  I. 


4.9 


For  a  >  0  define 


fa(x)  =  g(x)  +  ^w(x) • 


Since  g  has  only  simple  zeros  Chen  for  sufficiently  small  a,  f  €  Further¬ 
more  from  the  theory  of  algebraic  functions,  see  e.g.,  Wilkinson  [63],  f  has 
zeros  x.  (a),  i  51  U  {0},  j  *  l,2,...,p  ,  satisfying 


(4.15)  |x  (o)-xj  = 
j 


Pi'.g(x.) 


(pi) 

w  (xt) 


1/pi  df  1/pi 

a  L(l+o(l))  -  Micr  1(l+o(l)) 


and  zeros  y.  (o'),  i  *  l,2,...,r  and  j  -  l,2,...,s  ,  which  tend  to  y^  when  a  goes 
J 

to  zero.  Thus,  f  €  g(xn)  for  sufficiently  small  a.  Since  I!t(f  ,xQ)  *  ^(g,xQ) 


then  xi(fQ)  =*  xt(g)  for  i  =  l,2,...,k,  and  therefore 


1/P± 

dist(x1(f<j)  ,S(fCT))  -  MtO  (l+o(l))  ,  for  i  “  0  and  i  6  I. 


From  this  and  (4.15)  we  get  for  i  €  I, 


di.t<*1(f8>.s<f0»  Mt  “t  iktSt) . 

dist(XgtS(£) ) - Mj®  (1+0<1)>- 

Since  are  bounded  away  from  zero,  there  exists  ag>°Q  >  0*  such  that 


M 


l-2n 


zr  ajn(n+1)  (1+0(1))  a  1,  Vi  €  I. 


M0  -0 


This  implies  dist(x. (f  ),S(f  ))  a  dist(x.,S(f  )),  Vi  6  1.  Note  that 

I  (Trt  U  Cn 

dist(x  (f  ) , S ( f 

1  CT0  ac 

get  f  €  3(xq)  and 


dist(x1(f{J  ),S(fc  ))  -  dist(x0,S(fa^>)  J4  0,  Vi  %  I.  Thus  putting  f  -  f^,  we 


4.10 


min  dist(x. (f) ,S(f))  -  diat(xft,S(f))  f  0 
i«0,l,...,k  1  u 


which  completes  the  proof. 


5.1 


5.  MAIN  RESULT 


We  are  ready  to  prove  the  main  result  of  this  paper. 

Theorem  5 . 1 

For  any  positive  L,  any  sequence  of  linear  information  operators  71  *  {7L], 
any  iteration  without  memory  co  ■  6  $(7l) ,  and  any  starting  point  x^  €  C  , 

N(9,e,x0)  -  +  “,  Ve  <  l. 

Proof 

Suppose  on  the  contrary  that  for  some  e  <  1,  71,  cp  and  x^,  k  ■  N(m,€,Xg) 
is  finite.  This  means  that 


(5.1) 


€  3(Xq) ,  3ig 


€  [l,k]  :  dist(x.  ,S(f))  £  e  dist(x  ,S(f)) 


where  x^  *  cp^x^;  7L(f,Xg)).  Consider  now  the  operator  defined  by 


(5.2)  Tl*(f,x0)  ■  [5l1(f,x0),!R2(f,x0),...,!!^(f,x0)]. 

★ 

Of  course,  71  is  a  linear  information  operator  in  the  sense  of  Definition  (2.2). 

Me  Me 

Define  functionals  €  $(7l  ), 

(5.3)  cp*(xQ;  7l*(f,x0))  «c Pi(xQ;  5lt(f,x0>). 

★ 

From  Theorem  4.2  we  know  that  for  functionals  cp^  there  exists  a  polynomial  f^, 
f Q  €  3(xq) ,  such  that 

(5.4)  dist(x*,  S(fQ))  a  dist(x0,S(f0»  0,  Vi  -  1,2,. ...k, 

where  x*  ■  x*(fQ)  “  <P*(xQ;  5l*(fo’xi))’  1  *  l»2,...,k.  Due  to  (5.3),  x*(fQ)  *  x1(f0>* 
From  (5.1)  there  exists  i^  ■  iQ(f q)  such  that 


5.2 


dist(x1^,S(f Q) )  s  e  dist(x0,S(f0))  <  dist(x0>S(f0)) 

which  contradicts  (5.4).  Hence  Theorem  5.1  is  proven.  ■ 

From  Theorem  5.1  and  (3.8)  follows 

Corollary  5.1 

For  any  positive  L,  any  sequence  of  linear  information  operators  51  ■  [51^}, 
any  iteration  without  memory  cp  »  {cp^}  €  4(31).  and  any  starting  point  xQ  €  C, 

comp  (9,  «»Xq)  »  +  «,  Ve  <  1.  ■ 


6.1 


6 .  MEMORY 


In  this  section  we  briefly  extend  all  previous  definitions  and  results  to 
iterations  with  memory.  Let  H  and  3  be  the  class  of  polynomials  defined  as  in 
Section  2.  Let  m,  m  >  0,  be  an  integer,  and  let  L^  :  H  x  -»  C  be  a  func¬ 

tional  which  is  linear  with  respect  to  f.  Then  the  linear  information  operator 
*1>  21  ■  ,Lj ,  •  •  •  ,L^  ]  :H  X  C  -*  (C  ,  is  defined  as 

(6.1)  21(f,x(),x_1 . x_m)  -  [L1(f  ,z1,22,...,znH^1)  ,L2(f,z1,z2,...,ziftf2) . 

Ln(f’zl>22 . 2mfn)] 


where  z. 


'1  VZ2  ~-l 

1*2  C  f *  i » *2  *  ’  **  ,2nH-2^  *  “  *  ,Lj-l^f  ,Z1  ,Z2  ’  *  ”  ,2mfj-l^  ^or  some  functions  5  j  . 

j  ■  nrt-2 ,hh-3 , . . . ,n.  Let  t  be  the  class  of  all  such  information  operators. 

n  ,m 


nvfl  =  X-m  and  Zj  "  ?j(2l . 2nH-l,Ll(f'Zl,Z2,,"*ZnH-l)’ 


Let  21  *  {21.  ]  be  a  sequence  of  21. ,  21.  €  *  .  For  distinct  x„,x  . 

i  ii  n^,m  0  -i 

construct  a  sequence  of  approximations  {x^}  by  the  formula 


. .  we 

-m 


(6.2)  xt  -  p1(x(),x_1,...,x_tn;  21i(f,xQ,x_1 . x_m>) 


1+oH-n^  _ 

where  cp.  “  D  c  £  -»  £  are  functionals,  cp.  6  §  (21.).  Let  now  <p  *  {cp, } 

i  Ti  m  i  Ti 

be  a  sequence  of  functionals  cp, ,  cp,  €  §  (21.).  Then  cp  is  called  an  iteration 

li  mi  ■  ■ 

with  memory  using  31,  co  €  $  (21). 

—  —  -  -  ■  —  XQ 

Let  21  »  {21^}  be  a  sequence  of  linear  information  operators  with  memory, 

21,  €  f  ,  cp  *  {cp, 3  €  $  ,  e  be  a  positive  number,  and  x-,x  x  be 

i  n^,m  m  r  0  -1  -m 

given  distinct  points.  For  any  f  €  %  define 


(6.3)  N  *  N(cp,  e,Xg,x_^, . . .  ,x_m,f) 

as  the  minimal  integer,  if  it  exists,  such  that 


(6.4)  dist(xN,S(f))  *  e  dist(xQ,S(f)), 


and  N  •  +  ®  otherwise.  Let  comp(cp,e,XQ,x_1, . . .  ,x_m,f)  be  the  cost  of  computing 
x^.  Let  L,  L  >  0,  be  a  given  constant.  Then 


(6.5)  N(cp,«,x(),x_1, 


»x  _) 

-ttt 


if 


sup  N(9, e,xft>x  ,...,x  ,f) 

f63(x0)  0  -1 


where  3(xq)  is  defined  by  (3.6).  Similarly,  let 


(6.6)  comp(cp,e,xn,x  ...... x  )  if  sup  comp(cp,  e,x-,x  ......x  ,f). 

0  f€5(x0)  0  -1 


As  before,  there  exists  a  positive  c  such  that 


(6.7)  comp(qj,«,xn,x 


« • • • >x  ) 
-m 


cN (cp, e , Xq i x^ , •  •  ■ , x  ^)  ,  Vcd, c.Xq.x  ^,...,x 


By  a  technique  similar  to  the  proof  of  Theorem  5.1  it  is  possible  to  prove 


Theorem  6.1 

For  any  positive  L,  any  m,  ra  >  0,  any  sequence  of  linear  information 
operators  with  memory  51,  any  iteration  tp,  ^  6  $m(5t)  and  any  distinct  starting  points 

X0’X" 1’ * ’ * ,x-m  6  ^ 

comp(tp,e,x0,x_1,...,x_m)  ■  N(9,c,x0,x_1,...,x_m)  - +®,  Ve  <  1.  ■ 

Remark  6.1 

In  practice  one  often  wants  to  reduce  a  residual  error,  i.e.,  to  find  a  point 
x^  such  that 


(6.8)  |f(xk)|  s  c|f(x0)| 


6.3 


for  some  e  <  1.  Note  that  (6.8)  does  not  imply  that  x^  is  closer  to  a  solution 
a  6  S(f)  than  x^.  For  problem  (6.8)  we  pose  the  same  question: 

What  is  the  complexity  of  any  iteration  cp  using  linear  information 
solving  (6.8)? 

It  can  be  proven  that  the  complexity  of  cp  is  infinity  even  for  a  subclass  of 
3(Xg) .  More  precisely,  let  T  be  a  finite  dimensional  linear  operator  which 
maps  H  onto  £  .  Let  c  €  C  .  Define 

3(xq,T,c)  -  {f  €  3(x0)  :  T(f)  =  c}. 

For  any  iteration  with  memory  cp  6  $^(21) ,  any  e  <  1,  any  xQ  €  (£,  and  any 

•A  —  ^ 

f  €  3(xQ,T,c) ,  define  N'  ■  N' (cp,  e,c ,xQ, f)  as  the  minimal  integer,  if  it  exists, 
such  that  |f (xN, ) |  £  e|f(Xg)|,  and  N’  »  +  ®  otherwise.  Furthermore,  let 
“ 

N' (cp,e,c,xn)  -  sup  N’  (Cp,e,c,xn,f) . 

°  f€3(x0,T,c)  0 

Then  for  any  sequence  of  linear  information  operators  with  memory  21,  any 

cp  €  $m(2l) ,  any  T,  any  nonzero  c  6  CL  ,  and  any  distinct  starting  points 

x„,x  ,,..., x  €  C,  we  have 

u  - 1  -m 

—  u 

N'  (cp,e,c,x0)  -  +  »,  ve  <  1. 

In  particular,  this  also  holds  for  T(f)  ■  f(Xg),  i.e.,  for  the  class  of  all 
complex  polynomials  from  3(Xg)  which  have  a  fixed  value  at  Xq,  f(Xg)  *  c  f  0. 

We  want  to  stress  that  Theorems  5.1  and  6.1  can  also  be  proven  for  the  class 
3(Xq,T,c).  The  proof,  however,  is  more  complicated.  ■ 


7.1 


7 .  OPEN  PROBLEMS 

In  this  section  we  pose  a  number  of  open  problems  which  are  relevant  to 

the  questions  studied  in  this  paper. 

In  Theorem  6.1  we  prove  that  for  any  m  2  0,  any  linear  information 

■5  •  £5. 1,  31,  €  *  ,  any  iteration  <p  ■  {cp  }  €  I  (21)  and  any  integer  k,  there 

i  i  n^,m  l  m 

exists  a  "difficult"  polynomial  f,  f  6  3(xQ) ,  i.e.,  a  polynomial  which  requires 
at  least  k+1  iterative  steps  to  reduce  the  starting  error  dist(xQ,S(f) ) .  Let 
P  *  P(3t,cp,k)  be  the  set  of  all  such  difficult  polynomials  and  let  d  *»  d(3l,cD,k) 
be  the  minimal  degree  of  such  polynomials,  i.e., 

d  **  min  deg  f. 
f€P 

Problem  1 

Find  d  as  a  function  of  m,  k,  and  n^,n^ , . . • ,n^.  I 

It  can  be  shown  that 

k 

r-1 

(7.1)  d  £  (k+2)  (2+  ^  n£)  +  k. 

i-1 

In  general,  this  bound  is  not  sharp.  For  instance,  for  a  stationary  iteration. 


(7.2)  d  s  (k+1)  (nj+1)  +  k. 


By  a  stationary  iteration  we  mean  an  iteration  which  constructs  a  sequence  of 
approximations  by  the  formula 


(7.3)  xi+1  ■  9i(xx»*i«i». ••»*£.**  >xi»xi-l,,,,,xi.m^ 

for  some  3^  €  +n  m  and  cp^  6  «(5lj). 


7.2 


Theorem  6.1  states  that  the  set  P  of  "difficult"  polynomials  is  nonempty. 

It  would  also  be  interesting  to  investigate  how  "large"  this  set  is.  We 
therefore  pose 

Problem  2 

What  proportion  of  polynomials  from  3(xq)  is  "difficult"?  ■ 

In  this  paper  we  have  restricted  ourselves  to  the  class  3  of  all  complex 
polynomials  having  only  simple  zeros.  It  is  interesting  to  find  for  which  classes 
of  problems  the  same  negative  result  holds,  i.e.,  for  which  classes  of  problems 
the  complexity  of  finding  x^  using  linear  information  is  infinite.  Does  this 
hold  for  the  class  of  all  real  polynomials  with  all  simple  zeros?  We  summarize 
this  in 

Problem  3 

Characterize  the  classes  of  problems  for  which  the  complexity  of  finding  x^^ 
is  infinite.  g| 

From  our  results  it  follows  that  to  make  the  complexity  of  finding  xN  finite, 
it  is  necessary  to  use  some  nonlinear  information  about  f.  An  important  open 
problem  is  to  characterize  nonlinear  information  which  yields  not  only  finite  but 
relatively  small  complexity.  On  the  other  hand,  there  exists  nonlinear  information 
for  which  the  complexity  is  still  infinity.  For  instance,  if  2t(f,Xg)  ■ 

G(L^(f ,z^) >1*2 (f jZ^) , . . . »Ln(f »2n))  where  L^,...,Ln  are,  as  always,  linear  func¬ 
tionals  with  respect  to  f  and  G  is  an  arbitrary  operator  (nonlinear  in  general) , 
then  it  is  obvious  that  for  any  sequence  31  of  such  iteration  operators,  the  com¬ 
plexity  of  finding  x^  is  Infinite.  We  propose 


Problem  4 


(t)  For  a  given  nonincreasing  function  g,  g  :  £0,1)  -*  R,  find  informa¬ 
tion  21  and  an  iteration  cp  using  21  such  that  the  complexity 
comp(cp,«,x0)  s  g(e)  for  any  e  €  [0,1). 

(ii)  Characterize  the  class  of  all  information  for  which  the  complexity 
of  finding  x^^  is  finite. 


t 
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